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Introduction / 

The Uniterm SystM of Coordinate Indexing is a scien*. 
^tifically developed, simple and efficient »ethod for the or- 
ganization, storage and retrieval of information* Essentially 
it consists of analyzing the contents of reports into a basic 
vocabulary together with a teethed of retrieving their contents 
by anjr clement or combination of eleKentc in the vocabulary^ 
As a. result t it provides a degree of search effectiveness 
unobtainable through-conventional library catalogs* Tlje Sys- 
tem war. developed under an intensive research program conducted 
by Documentation Incorporated for the Armed Services Technical 
Information Agency (ASTIA);^ 

The features of compactness, f liexibility, economy of 
installation, ease of maintenance and ease of searching make 
the Uniterm Systea espeeially suitable for the control of 
technical docuwents whose full subject content is'frequenlly 
lost because of difficulty in gaining catalog control through 
conventional sjeans. The advantages of the System are derived 
frco the simple principles t±ieh are introduced in the follow- 

♦ 

ing pageji» \ 
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SECTION I ' 

GENERAL DESCRIPTION 

Language is based on'words* Many ideas^and concepts 
are expressed in language as combination of words. The nu^ * 
ber of such combinations for any body of information may be 
large, but the number of individual vocabulary terms used is 
often surprisingly small. For example, the number of chemi- 
cal element? is small compared to the number of compounds. 

In the Uniterm System of Coordinate Indexing, the in- 
formation containe:d in a collection of documents is analyzed 
into the simplest practicalword units of information — 
hence, •'Oniterm''. Each Uniterm is assigned a separate card. 
Each document is assigned a serial number, and the number is 
posted on all cards headed by the Uniterm^ by Which the- docu- 
"ment has been analyzed. The Word units usually consist of 
single-word ideas or concepts, each of which is associated 
with a body of related information. 

For example, the word ^'air** is associated with a nuin- 
ber of different ideas in the phrases, **air ducts'*, '^air 
speed", **cold air**, etc. There' are two ideas or terms in 
the phrase, •*tir ducts** — one the class of ^air^ ideas, and 
the Qther the class of duct ideas. When we ure the two terms 
together, we perform the operation known as logical conjunc- 
tion. This means simply the combination of "air" and "ducts** 



and it is obvious that the same concept can be expressed as 
••ducts" and *'air**^ Thus .the order of terms is immaterial 
since the same total body of information is represented by 
either arrangeweKt as in the following diagram: 



/ Air 




1 Ducts A 




I Air 





Ducts 



Figure 1. • 
. The overlapping or common area of ^air** and **ducts** 
represents a smaller body of inforiration than either of the 
individual areas* It is easy to see that a more specific 
area can be obtained by using a larger number of terms :ih 
conjunctiont thus harrowing the field of search as in the 
following diagram: 




Air Duels Icing 



Figure 2. 
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. Since the same logical conjunction is obtained re- 
gardless of the order of the terms, the three separate unit 
terms, ^air'\ "ducts", and "icing", when coordinated, are / 
equivalent to the six possible ways by which this- informa- 
tion can be represented in conventional indexing systems: 

AIR DUCTS - ICING 
' DUCTS, AIR - IGING 

ICING - AIR DXTS > • - 

ICING - DUCTS, AIR 
AIR - ICING - DUCTS \ 
■ DUCTS - ICING - AIR 

Simplicity of Catalog Form 

In the manual Uniterm System, as explained in de- 
tail in the following pages, this logical conjunc/ion is 
achieved by searching for the document numbers which are com- 
mon to two or more Uniterm cards. There is no reason to assume^ 
that "air" is any more important than "ducts" or "icing" and 
consequently no reason to subordinate any one term with re- 
spect to any other term as is done in conventional systenis of 
indexing and classification. The making of such assumptions 
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at different times for different cases gives rise to elaborate 
cross reference structures, of such steadily increasing complexity 
that the conventional systemseventually either become meaning-* 
less or make extreme demands upon. personnel staffs in maintain* 
ing the systems* integrity. By its planned indifference to the' 
order of words, the Uniterm System eliminates the need for con* 
ventional cross references. 

Economy cf Catalog Space 

Elecause of the elimination of permutations and coa^ ' 
binations of basic ideas used in most present-rday systenSt a 
dramatic saving in catalog space results from the use of the 
Dni term System, The size of the System is a function of tiie 
number of vocabulary terms rather than of the. numbier of ex- 
pressions of ideas generated by the combination of terms. 
For a collection the Size of ASTIA's, this reduction of catalog 
size is in. the order of 9094. • 

After a body of information has been analyzed into 
the basic ideas or Uniterms, the number of terms increases 
very slowly as the system grows. However, the number of per- ^ 
mutations and combinations of these ne^w basic terms increases 
rapidly and exponentially, in fact by (2'^-l), where n is the 
number of Uni terms. 



Operational Benefits ^ 

The indexeris the first to benefit from the elimira- 
tion of the permutations and combinations of words found , 
conventional systems. Freed from the time-consuming neces- 
sity of making subjective decisions concerning the order of 
words-;and of creating complicated and highly specific index- 
ing phrases and cross references* he s^ssigns Uniterms rapidly 
Tnd liberal ly« ikying the foundation for a depth of analysis 
hitherto impracticaU The poster* who transfers numbers to 
Dniterm cards* benefits becauie his task is simple compared 
to the corresponding work ofj preparing and filing full cata- 
log cards for eack assignment in a conventional system. The^ 
searcher benefits! because he can address the coordinate index 
from any point of view because he can be as specific or as 
general as he wishes and because he heed not wonder about 
the form of expressfion used by the lndexer> 

Manual and Machine Maripulation 

The logical fragmentation of catalog elements inher- 
ent in the Uniterm System makes retrieval of information 
possible by machine or manual methods ♦ Currently under de- 
velopm(|nt is a machine which will permit random filing and 



'retrieval of Unitarra cards for petting end aetrching. Also 
being developed is a completely automatic indexing machine 
which will present^the document vnumbers in answer to reference 
questions tyoed^djit on a conventional typewriter keyboard; 

While the magnitude of the overall problem of infor- 
mation control wade the need for machine systems v|^ppa?ent 
many years ago, the' search for a manual method was renewed 
with the realization that there are many small installations 
in nei^d of an^ improved manual method of infortMition controU 
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hysical Appearance 



The Uhi tens System in its manual form uses cards of 
any convenient sise. 8uch\as 3- x/5^N4" x 6% or 5" x 8". 
in conventional catalog card trays, visible index filifs, or 



looseleaf/volu»e8. The cards have jspaces at top an'd bottom 



for the lini terms and are divided vertically into tf!n columns, 

- - ^ ; r-.- s - • ■ 

numbered' from zero througl^ nine, in »i 



which document 



accession 



\ 1 ^ 

\ numbers are posted* The columnar arrangement i$ designed 

' : " ' " '.V J- 

simply to break up the mass of\ numbers posted on the cards* 
The Uniterp card*looks like this in use: 



* Uniterm cards can be printed locally by the user, or, &s a rnatter 'of 
information, they can be obtained from Documentaaon-In'corporated, 
-2521 Connecticut Avenue, R W. , Washington 8v^D, C/ at a cost of 
$15, 00 ger thousand for the recommended.5*"x 8r size. 
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Ease of Search 

To demonstrate the simple practice of logical conjunc- 
tion oMIniterros/to^ find reference to wanted information, the ^ 
following sample cafds^orrespoijfd to the "air"i ''duct"t **icing" 
example described in Figure 1 and 2 on page 2. 
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It is indicated here that in our body of literature 

•J 

there are twenty-four documents containing information on 
*'ducts,l; t^erity-nine on "air"; and twenty~one on^"icing'\ • 
K Some of the "duct"- information may be on gas ducts, water ducts, 
alid air ducts. We are concerned with finding those having 16 
do with "air ducts icing". The eissence of any successful 
stearch is to narrow the field of search. Thus, as in Fig. 1, / 
the area of overlap of duct and air information defining tha/ * 
on "air ducts" is determined* by the numbers coimon to both 
Uniterm cards^ The arrangement of numbers by final digits and 
in ascending qrder^ makes it easy to determine that document 
numbers 230, 11, 882, 34, 785, ;216, and 447 pertain to "air 
ducts". The field of search is already narrowed to seven docu- 
ments. By comparing these seven document numbers with the 
njumbers on the "icing" Uniterm card, it is determined the four 
documents (numbers 230, 882, 785, and 216) contain ^information 
on "air ducts icing" (seejFigure 2). " . 

... f- 

Basic Factors^ for Ease of Search 

There are several factors which contribute to the ease 
of retrieving information from the Uniterm System of Coordinate 
Indexing. The index headings are chosen and recorded as simple 
"Uni terms"; the /documents nre identified in the simplest manner - 
by serial accession number; the numbers are recorded in ascending 
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order on Uniterm cards. Retrieval of information is likewise' 
accomplished in the simplest manner - by visual determination 
of numbers* common to two or more Uniterm cards and by rapidly 



narrowing ^he field of search with each comparison made. It 
will be noted that the time of search is determined by the 
smallest group of numbers to be compared. 

The foregoing. operation,, known as logical conjunction, 
is the reversal of the process of fragmentation which occurred 
When the Uniterms were assigned. It can be seen readily that 
reference 'questions involving search technique by alternation 
or negation (such as either "air" or "ducts" or both; or all 
doeuments on "icing" with the exception of "ducts") can be 
handled with equal facility, 
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SECTION II 

UNITERM INDEXING WITirASITIA CARDS ' • > 

/ 

For those users of ASTIA services who may wish to adopt " 
* th^ Uniterm System in controlling ASTIA materials, Uniterm 
tracings will be included on regular ASTIA catalog cards in addi- 
tion to cpfiventional headings. This manual gives instructions for 
the installation and use of the Uniterm System utilizing ASTIA 
cards as document references. Additional instructions are pre- 
sented so that non-ASTI A; material can be processed to provide an 
integrated ifile oif holdings. 

Beginning with ASTIA document number ISOQl, ASTIA catalog 
cards will contain Uniterm tracings on the reverse side of the 
card, these cards will look like this: 



AD-2120 



Accession Ho.. 



Maasachuisetts Inst, of Tech., Cambridge. 
TITANTUM RICH TFTANIUM- CHROMIUM -OXYGEN 
TERNARY SYSTEM, by Chlh-Chung Wang, Nicholas ^ 
J. Grant, and Carl F. Floe. Nov 52, 19p. inch illus. 
tables, 13 refs. (WADC Technical rept. no. 52-255) , 
(Contract AF 33(038)8754) 



1. Chroraium-oScygen-tilanium 

systems 
I. Wang, Chlh-Chung 
IL Grant, NichoUs J. 
in. Floe, Carl F. 
IV* Wright Air Development Cen- 
ter, Wright-Patterson Air 
Force Base, Ohio 



Metallograohic and x-ray methods were used to inves- 
tigate the Ti-rich corner of ^ — * 

the limits ci 10 wt. -% O and A[)-2120 
were prep^ixed by an arc me 

came increasingly brittle wJ jj^a a face -centered cubic structure with a lattice con- 
tent. The 1200OC isotherms ^^^^ ^3 go Kx. This phase does not form directly 
determined. Thea +/J field ^^^^ the liquid phase. The temperature range in which 
one area the /J phase cannot xi^Cr^O Is stable was not determined, but it is poo- 
but quenched specimens froi gjj^g ^ transform into a or other phases at 
a and acicilar a phases. T higher temperatures, 
transform from /? by a mech 
tensitic ty)^ of transformat! \ 
firmed the existence of a tei \ * 



Front 



Back 



DIV: Metallurgy (17) 
SECT: Structural Metallurgy (2), 
^Llght MeUls and Alloys (6) 
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Figure 5 
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These cards differ from earlier ASTIA cards in two 
respects: 

1« A space is provided immediately following the 
AD number for the serial accession number to 
be assigned by the user* 

2t Uniterm tracings are provided in the right 

margin on the reverse of the cards; they repre- 
sent ASTIA's Uniterm subject analysis of the 
document. 

Catalog cards produced by the user or by any other ^ 
activity, such as the Atomic Energy Commission, the National 
Advisory Committee for Aeronautics,, and the Library of Cong- 
ress, can be integrated with ASTIA cards by assigning each 
card its own accession number. Any activity starting a coor- 
dinate index should assign number 1 to the first card placed 
in the accessions file, number 2 to the second card, number 3 
to the^third card, and so on, regardless of the ASTIA document 
number or document numbers of any other card-producing agency« 

It is recommended that all the materials covered in 
a single integrated Uniterm System be stored in order by the 
serial accession numbers assigned by each user in which event 
the accessions file serves also as the shelf list. If the 
materials must be filed 4n some other order, such as by source, 
subject classification, ASTIA number,, etc., location symbols 
must be shown on the cards in the accessions file; the need for 
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shelflists for other arrangements must be decided without 
reference to the Uniterm System* Cards can be added to the 
accessions file without adding the materials to the collection 

V 

for subject headings and classification numbers can be con- 

/ \ 
verted easily to Oniterms without reference to the materials, 

especially when titles and abstracts are used to aid in the 

conversipna 
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SECTION III 
INDEXING AND POSTING 



The ^ules of - the Uniter* System of Coordiviate Indexing 
• , , /. . . V . . 

are giTej»\ in Section IV of this wnual. These fifteen rales 

fhoald be studied carefully by those engaged i a both indexing 



and posting! It is always desirable, of eouirse. for searchers 

to be fan! liar with the rules even though they not be regular 

■ ■ ^ ■ \ ■ 

reference workers. 



Indexing . ^ 



Actually, the indexer is concerned primarily with Rule* 
and 2 which siaiply tell hiii to^deteraine the key words repre- 

senting the subject content of the docuaent and how to record . 

/ ' ■ ' 

these key words for posting^ The indexer is not required to 

create and maintain a list of approved Oni terms, for such a . 

list is created and maintained as the coordinate indepc itself ^ 

Only rarely does the indexer find it necessary to eonsult the ' 

coordinate index as he assigns Uni terms to the aceesiidned 

materials. Consequently, there is a great freedom in amending 

the vocabulary to describe the changing characteristics ..of a 

field as reflected in its literature and to continually 'enhance 

the effectiveness of the coordinate\ index without altering 

previous entries^orithe structure of the inde;^,'' ;JThesej features, 

plus the simplicity of the rules, make the-indexiny operation. 
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much more rapid and efficient with the Uniterm System than with 
any. other method* 

^ , Posting 

The posting of serial accession numbers on Uniterm cards 
is equivalent to preparing and f|ling cards in conventional 
catalogs » In both systems care must be exercised to achieve 
accuracy. The posting operation is/ the tedious part of maintain- 
ing a Uniterm System, although experience has demonstrated that 
with proper organization of the work it is less tedious and more 
economical than card preparation and filing* 

The poster/^as but one major decisi'on"to^ake: that \s\ 
whether a iBXxa is ^free" or "bound" when it is used in the filing 
^ position./ Rules 3, 4, and 5 in Section IV govern this determitia- 
tion. Generally speaking, words susceptible, to combination, with 
other terms in a system ar** "free** and those found in combination 
with only one^ other word in the system are **bound**i Bound/ terms 
tend to become free terjns as a system grows. Therefore, most 
,ASTIA Uni terms will be free terms. 

The poster wiit\l also be concerned with word form, i^e.,-. 
singular or plural, substantive or attributive, synonymous and 
homonymous, etc.' Rules 6 through 15 cover these points. 
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Neatness and accuracy are very important in posting. 
Careful hand numbering or typing/ may be "satisfactory. Ring- 
Style rubber s temps and numbering machines with repeat settings 
minimize transcription errors. Small adding or bookkeeping 
machines may be most satisfactory for large installationSt 
for they can be secured with repeat settings, horizontal tabu- 
lation for the cdlumnSt easy vertical alignment for the lines, 
and carriages to suit the width of card; and they produce 
legible results rapidly. 

/ The Uniterm System of Coordinate Indexing is adaptable 

'\ ' ' / " • ^ r ' 

to a greatj variety/ of conditions. In the places where coordi- 

nate indexes are^now in operation, no two exactly resemble each 

other. Because- an index is literally tai lored to the informa- 

I - 

tidn collection of each organization, ''free'* terms in one 

vocabulary ^are not "free" terras in another, and so with phrases 

/ 

and inversions. Some include authors * surnames { others do not. 

. . /' ^ ^ . 

/ , - 

/ Growth of Uniterm Vocabulary 

-# 

It is useful to know what to expect during the early 
growth of a coordinate index. Experience has shown that the 
number of new Uniterms grows rapidly at the beginning and can 
be expected to exceed the number of documents indexed; At some 
point, perhaps between 1000 and 3000 documents, tlil'' number of 
documents equals th.e number of Uniterms and soon^^exceeds the. 
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number of Uniterms^ since the vocabulary is stabilizing at a 
slow rate of growth* Therefore, in the very early phases of 
Uniterm systems there are fewer cards than documents, whereas 
S the reverse is true in the case of the conventional subject head- 
ing or a classified catalog/ 

Since an average of eight Unite.rms may be assigned 
to each document, the growth in assignments may reach many times 
the growth in Uhiterms, Figure 6 shows the growth of Uni terms 
and Uniterm assignments for a collection of 3000 documents. 



3000 



30.000 
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Any installation can compare its experience with 
this graph by plotting a cumulative record of its new Uniterms 
/ and assignnents against the number of documents indexed* 
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SECTION IV 
RULES OF COORDINATE INDEXING ' - 

/ 

^ lo Determine the key words which represent the subject 
. content of the item being indexed ^ 

Key words are not limited to single common weirds in tiie 
English dictionary. They include phrases, Arabic numerals, 
alphabetical characters, model and project numbers, such as 
AN/ARN-5 and MX-772, in additicm to the nouns, adjectives, 
I gerimdSy participli^, and proper names which make up the 

bulk ofany Uniterm vocabulary, 

2. Record the key wordy on the serial accessions card 
so that every retrieval word is a filing Word in 
the posting operation^ . 

This is accomplished by putting every word in a phrase In 
the filing* position; thus, if the phrase **ga's turbines'* is to be 
used, **turbines'* must be.recorded in the filing position as 
well as "gas". The poster ftien ascertains whedicr the "tur- 
bines** card in this'situatlon bears the single word, **turbines**, 
' or must include /gas** and consequently read, **turbines, gas**; 

abo whether me **gas'* card bears the single wwd or the phrase, 
— ^gas-turbinM^(sce'RuleS"3r4; and 5)» > 

' / X ' .'• 

NOTE ; A few words are not considered to be retrieval words and need not be 
recorded on serial accessions cards in the filing position. Examples are: 

-Effect!** and "Methods**. ^ 

/ 

/ ■ 

/ 

/ 
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If a word is used alone as an indexing terntt it is 
called a ^'free'' term. Enter it as a single word on a 
Uniterm card » 

In the case of a documerii on -Helium inv^Air Turbines for 
Gasoline Pumps- , -helium" is a "free terra-. By virtue 
of being used alone once, it ^remains a -free- terra in tbc 
. future and may not be^used later in thc^ vocabulary as part 
of a phrase. " ^ s 

If a word in the fiMng position is used with only one 
other word in the vocabulary, it is a ^'bound'* or *4ot free"' 
term^ Enter eacn word of a two^word phrase on a separate 
Uniterm card in the filing position, and add the other 
word if the first word is a ^^bound*" term » ^ ! 

Using the example in Rule 3. when the poster considers 

the phrase "air turbines-, there are only three Uniterins 

in the vocabulary:' "helium-; "air-, and -turbines-. ' 

Since both wofdl; of the phrases fit this Rule number 4, 

••air turbines" is typed on one card and^*!tuiblric$,^alr? — - — — 

is typed on another* ^ 

If a word occurs in the system in combination with two 
or more words, it is a ^'free'' term. Enter it as a single 
word on a Uniterm card ^ 

25 
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' Referring to the example in Rulea 3 and 4, the above situation occun 
when the poster is ready to add "centrifugal", "gasoline" and "pumps" 
to the vocabulary. "Pumps" is a "free" term became it occun in com- 
bination with "centrifugal" and "gasoline" 'but the "eentrifugal" card 
is typed as "centrifugal pumps", and the "gasoline" card as "gasoline 
pump" in accordance with Rule 4. Note that the first word, the word 
in the fOing position, is the one to consider whether "bound" or "free". 
"Pumps"'h s free term in the filing paition, but xt is added to 
"centrifugar and "gasoline" because there is nothing on the subject , 
^^^^ of Cvjiitrifugarin the system except centrifugarpumps, -ind nothing re- ' 
lated to gasoline except gasoline Vunips. "Free" terms and "bound" 
lei^ can be added freely to "bound" terms, but no terms can be added 
to "free" terms. 

NOTE: As the posting is continued, always in serial number otder, more terms are ' 
added to the vocabulary and. actual associations of wwds increase .rapidly in the 
system. The effect of Rules 3, 4, and 5 is to "free" most of the terms, so that a 
coordinate index for several thousand items soon.has single words for the majority ^ 
of Uniterms. If, following the example used above, a report on "air ducts" enters 
the system, the poster must "free" the word "air" according to Rule 5, because it 
is associated with "turbines" as well as "ducts". The operation is the simple erasure 

] 

of "turbines" from the "air turbines" card. Note that the serial numbers are not 
disturbed when a phrase U shortened to a "f^ee" term. 
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6* Enter substantive forms .in the plural only, provided 
the singular can be inferred convenienily without broad 
. change of weaning ^ 
Example: Grasses 

JT^ — Enter singular forms after plurals where the appearance 
of both terms facilitates indexing and searching . 

Example: Supplies; Supply " 

Enter the singular form of foreign words and add the 

plural > 

Example: Fungus; Fungi 

Spectrum; Spectra ' ^ 

i» 9. If the singula/ form is broadly generic or defines 
. a field ^^nd the plural is more substantive, enter the 
singular and add the plural . 

Example: Temperature; Tenipefatures ^ 

10. Add attributive or adjectival forms »to the substantive 
words with which they stand in the closest sense 
relationship. 

Example: Geophysics; Geophysical 
Sun; Solar / 
Hydrostats; Hydrosutic 
m Enter gerundive forms and add the participles^ , 

Example: Sintering; Sintered 
Printing; Printed 

NOTE: The form of the endings of words (singular, plural, nominative^ etc.) docs hot 
"affect the fUlng order as in conventional systems, since each word appears only once 
In the filing position. 
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12 » Consider the first word ^of proper names and foreign 

phrases to be a ^^bound'* term and enter the full phrase. 

Example: Black Sea 

Clostridium botulirium ♦ 

Clostridium pexfringeiu • 

• (No entries are made for the second word here) 

13. Enter accepted chemicSil terms occurring ia$ one word 
in the f6rm in which they appear # 

Example: Amines ^ 

Phenylamines 

Diphenylamines - ~ . 

Niuodiphenylamines 



14; Where true syncnyms occUr» enter the well-known form 
and make a see reference from the other form. 

Example: Petrol see Gasoline ^ 

Since the see references are consulted rarely, they may be 
kept conveniently in another file. 

15. Enter homonym as one Uniterm. Where meaning may 

j 

prove to be unclear in coordination^ show meanings 
parenthetically on separate car^s. particularly where 
many serial numbers are involved. 

Example: Pitch (substance) 
Pitch (motion) 
Pitch (acoustics) 
Pitch (angle) 
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SECTION V 

REFERENCE WORK WITH A COORDINATE INDEX 

The. visual reference use, or senrching, of • coordi- 
nate index consists of coaiparing two or More Unitena cards to 
deteraine nvabers coanon to the cards. The coMaon nunbers 
denote the area of logical conjunction of the eleaents of 
the question. 

It was explained in Section III that. because of the 
size of the ASTIA collection, awst Onitenas on ASTIA cards \ 
will he "free" teraa. However, nany ASn^ users will find 
that ASTIA "freirtenBS might properly be "bound" tenas in 
their particular systems in view of their specialised interests. 
If a search shows that all nui^rs on the "air" card are coajwon 
to those on the "duct" card, the Oniterw can be changed to 
"air ducts" and "ducts, air". The change nakes it unnecessary 
to coordinate again under similar circuastances, for either 
card shows at a glance that "air" and "duct" are- bound terms. 

For a variety of reasons, reference workers may wish 
to prepare a record on cards or slips of all coordinations made 
for iearchers. This record serves as: 
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1. Call slips for documents and for abstracts 
to be consulted* 

2* A file of answers for cases irtiere frequent 
coordination of the saM terms are Mde^ thus 
making the repetitious coordination of the 
sane terms unnecessary* 

3« A source for freqttent tabttlatioRS to show 
the volume and kind of reference work which 
has been performed^ thus providing a record 
• noX available in most libraries* 
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.^^venteen PSI Projects at The University of Texas at Austin 

' James E . Stice 



This is a progress report on the PSI- project at The University of Texas 
at Austin, sponsored, by a grant from the Alfred P. Sloan Foundation. Under 
this grant 17 PSI courses were- developed by the Associate Investigatprs , l^ 
of them in the College of Engineering and five in other colleges. The ^Associate 
•Investigators and the* course each developed are: 

^ .-■ - 

1 Structural Dynamics - Roy R. Craig, Assistant Professor, Department of . 

Aerospace Engineering and Engineering. Mechanics 

2 Design of Structural Systems in Timber - David W. Fowler, Associate 

Professor, Department of Architectixral Engineering 

'3. Process Analysis and Simulation - David M. Himmelblau, .Professor, 
^ Department of Chemical. Engineering ^ 

4. Electrical Engineering Laboratory I - Charles H. Roth^/ Jr.,, Professor, 

Department of Electrical Engineering 

5 Electrical Engineering Materials - H. LyndohrTaylor , Associate Professor 

Department of Electrical Engineering 

6. Introduction to Engineering Analysis - Nancy S. Hamilton, Instructor, 

Department of Mechanical Engineering ■. 

7. Introduction to Nuclear Reactor Theory - Billy V. Koen, ff^"^^ .^^ 

Professor, Department of Mechanical Engineering 

8 Dynamic Systems synthesis - Lawrence L. Hoborock, Assistant Prof q^ss6r, _ 

Department of Mechanical Engineering 

9. Engineering Statics - Wallace T. Fowler, Associate Professor, and Paul 

E. Nacozy, Assistant Professor, Department o^ 
■Aerospace Engineering, and Engineering Mechanics ^ 

10. Engineering Economics - William G. Losso, Professor, Department of 

Mechanical E;agineering * 
^ . . 

Introduction to Operations Research Charles S. Beightlor, Professor, 

Department of Mechanical Engineering 

probability and Statistics for Engineers - Gera.ld R. Wagner, Assistant 

• Professor, Department of Mechanical Engineering 
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EDUCATION 4WELFARE 
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13. Basic Cataloging and Classification* - Dillie Grace Herring, Assistant 

Professor, Graduate School of Library Science 

. 14. Freshman English Composition - Susan. W. Wittig, Assistant Professor, 

Department of English 

15. Principles of Chemistry - John M. White, Associate Pufessor, Department 
. ^. ^ of Chemistry ^ 

^ ' ' ■ ■ ■ , 

16. Engineering Physics I t Austin M. Gleeson, Associate Professor, Department 

of -Physics - • " 

■' 17. Principles of Audio and .Visual Production - Robert D. Brooks, Associate 

Professor, Department of Radio-TV-Film 

Each Associate Investigator developed^ his course and taught it during one ' 
semester, then revised the course in light of the feedback received from proctors 
,ar)d students and offered it for a second time. All courses were supposed to ; 
follow the "pure" Keller model. In fact, all did not; many professors injected 
slight variations, depending upon their own teaching styles and personalities. 
None of these variations was believed to effect the' intent, of the project. The 
final report will discuss these variations in detail. 

Xn addition to the development of courses, the project was to investigate 
nine questions often asked about the PSI technique. These "ctuestions will be • 
individually discussed later in this paper, together with the answers we have 
obtained from the data received to date. 

■ ■ ^ / • . 

An Advisory Board was selected to provide assistance and guidance to project 
personnel during the period of the grant. The permanent members- of this Advisory 
Board were : Dr. David G. Born, Department of Psychology, University of Utah; 
Dr. Bon A. Green, Jr., Center for Personalized Instruction, Georgetown University; 
Dr. Ered S. Keller, Washington, D.C.; Dr. David T, Pratt, Department of Mechanical 
Engineering, University of Washington; Dr. J. Gilmour Sherman, Department of 
Psychology and Center for Personalized Instruction, Georgetown University. In 
addition, several people served as temporary members of the Advisory Board because 
of individual expertise they could contribute to the project. These members 
were: Dr. Amogene F. DeVaney, Department of Mathematics and Engineering, Amarillo 
College; Dr. Gerhardt F^Paskusz, Associate Dean of Engineering, University. of 
Houston; Dr. E. Joseph Piol,, ECCP Project, State University of New York System; 
Dr. George T. Semb, Department of Human Development, ^Jniver si ty of Kansas; and 
Dr. Borne t S. Swanson, Department of Chemical Engineering., Illinois Institute 
of Technology. • , ' 

The project began on January 1, 1973 and will terminate December 31, 1975. 
The questions which we hoped to answer during the covurse of the project, together 
with the tenative answers derived from the data . analyzed up to this time are: 

1. DO students learn more (or better) under the PSI met hod than under 
"c6ilT>entional" methods? 

^Achievement measures were compared between 11 PSI courses and associated 
' control coiireea. Students, in the PSI courses did significantly better in five 



of tho courses, uhere wai> no difference betwueii the two gioups in five coursses, 
and tho control class. did better than the PSl class in one instance. Thus ten 
•out. of the eleven ,classos did as well or' better under PSI than under conventional 
^teac!iinq methods. ^ t— 

All acluGvomunU moairuroii were final oxam data, except in the erase of the 
Eugxnoerimi Physics I ccur.!. lu that course there was no significant difference 
l)eUween the PSI physica class and the control class in an advanced placement 
'.test devised by the Dep.irtinent of Physics. The motivation was the same for 
both groups since the Advanced Placement Tost results did not effect the grades 
of either- group of students. The statistical analyses were controlled for 
grade, point average, Scholastic Aptitude Test (SAT) verbal sco^e, SAT quantitative 
score, SAT total score and where applicable the score on the. College Entrance 
Examination Board Level I Mathematics Achievement Test. This was done to remove 
initial intergroup differences in aptitude or achievement. 

PSI undergraduate, students in the jnid-range of grade point average and with 
SAT scores of around lOOO^tended to do better than similar students in the control 
courses. Data are limited and are not statistically significant, but there is a 
definite trend. In the single graduate course (Library Science), students with 
a graduate record exam verbal score, greater than 600 did better than similar 
students in the control class. The mean graduate record examination ve'rbal 
score is 500 for this group, so a score of 600 puts a student in the-84th per-, 
centile. It thus appears that the better graduate students^Lh the pSI course 
did better than their peers. Among the undergraduate students the average 
students in PSI classes did better than their peers in control classes. 

2- Are the higher grades obtained in PSI courses justified? 

• In six out of nine comparisons, the A students in contrpl classes 
scored significantly higher, on the final examinations than the A* students in 
PSI courses. In the othe;: three comparisons there was no significant difference 
be.tween the group's. In no case did the PSI students do better. 

In six comparisons of B- students, three control classes had better final- 
exam scores, while in two comparisons there was no significant difference, and . 
in one case the B students in' the PSI- course did better. ^ ^ 

It must be pointed out that there was a significant difference in motivation 
between the PSI students and students in the control classes. In aU cases the 
student's. in the control classes received a significant portion of their final 
grade in the course from their final examination. In many cases the grade on 
the final examination had no effect on the students in the PSI classes and in 
no case did tho PSI students" final elimination grhde count more than 2b% ox 
his .course grade. We are obtaining more data from the Engineering Phys^c^ ^ 
class this kpring. Doth the PSI section and the control sections will • 
Physics Department Advanced Placement Test which will effect the grade of neither 
group, thus adjusting for the motivational differences present in the comparisons. 

3.' Do PSI students exhibit a significantly di fferent long-term retenti-pn-of " 
course content than students in conven tional courses? 

We did some follow-up studies of students. in both PSI and c6ntrbl classes 
analyzing the grades of both groups in a course that followed the PSi course. 
The results were mixed. . ' 

lUe PJil course in engineering statics was first offered during the spring, of 
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\ 1973. Students from both the PSI statics course and the conventional statics 
course- later- took Engineering Dynamics and/or Strength of Materials, fnexc ^ 
was no significant difference on final exam scores between the two groups m-^ 
the Engineering Dynamics course, but the control •group scored higher oh the 
final examination in the course on Strength of. Materials. The PSI Engineering^ 
Statics course was revised during the suimner 1973 and offered again during, the 
fall 1973. There was no significant difference between this PSI group and theiir 
associated control group in the final examination scores in either Engineering 

■ Dynamics , or in Strength of Materials. It appears that the PSI Statics course - 
improved as a result af the revision. However, the students in the c9ntrol 
class had a significantly higher portion of A's and a significantly lower pro- 
portion of D's in Engineering Dynamics. In Strength of Materials the. proportion 
of A!s was approximately the same for both classes, but the control had a sig- 
nificantly lower proportion of D grades. 

The graduate course in Library Science was compared with its control group 
with, respect to final examination scores in the course following Basic Catalogi'ng 

■ and Classification. There was no significant difference between the two groups. 

In Introduction to Engineering Analysis (the pre-calcvilus mathematics course'V, 
?SI students made a significantly higher proportion of A, B, and C grades in 
the first semester of calculus than did their associated control groups. Also, 
the control group had 39% D's and F's in the first semester of .calculus, wnile 
the PSI group had only 9% D's and F' s. This result was highly significant 
(p less thanf .01) . ■ ' . , ' ' ' . ■ 

4, Do -students in PSI courses J-eafn how to study? j - 

Freshman and sophomore students were pre-tested" with ^the Brown- 
Holtzman Survey of Study Habits and Attitudes. At the conclusionof the semester 
the same test was administered as a post-test. The Brown-Hdltzman test has 
seven sub-scales: study oreintation, study attitudes, study habits, d^lay _ 
avoidance, work methods, teacher approval, and education ac^ceptance. In-^botn 

■ spring and/ fall 1973 there was no significant difference between PSI sections 
and control sections on the delay avoidance sub-scale pre-^test. On the post- 
test this was significant (p = .07). On the education acceptance sub-scale 
pre-test differences were insignificant but the post-test; difference was highly 
significant (p = .02), with the PSI students having the higher "'^^"J^^^^- 
Those results indicate that. PSI students were not as likely to put work off a. 
control students, and that the PSI students were more accopting of educational- 
objectives and practices. ■ , 

Studeht objective opinions also were sought to get' at an answer ' to this 
quo:;tion. Of 840 students sampled 57% said "Yes" or /'Definitely yes ., their , 
study habits had improved as a result of i'SI. Neutral responses were given by 
234, and 20% said "No" or Definitely no". 



5. can PSI materials developed by a given professor be used at another 
University with roughly equal results? 

Data to answer this question were obtained from a PSI Summer institute 
in Statics which was given at the University of T.-^xas at Austin during the jummar 
of 1973. Twenty-two community college and four-year college teachers attendea- 



this insfcitutie, which lasted for a period of nine weeks. These teachers took 
the course 'xn fengincering Statics which had been developed "in the spring of 1973 
,by.Drs. Powler and Nacozy. All took the course as students; t:hosG who- finished 
early proctorcd their classmates. When everyone had completed the course,, the 
.last several weeks were spent in revising it, During the* same period^, the 
teachers received continuing instruction in the PSI method, in writing instruc- 
tional objectives, methods, of testing, and classroom tnanagemeht. The enthusiasm 
of the participants was high, and , all considered the institute to have been very 
successful. , • 

During the following academic year, 11 of the PSI Institute participants used 
the materials to teach the course at ^their schools. The other 11 did not do so 
for several reasons. Some were not able to get a sufficient enrollment to offer 
the course at tjieir school; three retdraed to graduate school themselves-; and 
thus were-not-actively teaching at the.^time; two others did not teach the following 
year ."^ Of the 11 participants who used \the materials, all said the transfer was 
successful. Nine said the materials re^juired little revision for us^ at their' 
home institutions, and nine said the matWials wepe not too difficult for their ^ • 
students. All 11 said that in their opinion the course improved their students' 
study habits. The 11 iparticipants who taight a PSI Statics course at thei^ own ■ 
institutions said they would not have wanted to tackle the job without having 
attended the PSI Summer Institute, and they thought the nine-week time period was 
about right r eight weeks would have been-a minimum. \ 

The participants who taught the PSI course encountered problems. The teachers ; 
from the community colleges were unable to get many proctors, because most students 
transfered to a senior college after completing; their course. All said it yas, 
difficult to get money to pay the proctors. Also they reported some of their _ 
faculty colleagues complained that the Statics course took too much of the students, 
time. Further, the PSI, teachers didn't. want to acquire the reputation of being 
"easy" graders. Finally, there were reports of administrative objectipns. to the ■ 
large proportion of A grades. ^ 

•The Summer Institute participants who taught the course at their schools^ , 
devoted approximately one-fourth as much time to teaching the course as th^ 
University of Texas at\ Austin course developers had invested while developing 
the course. 

Th& only significant difference between results at the University of Texas at 
Austin and the results at the other schools, was that the number of students ^ 
dropping the course was significantly larger at the other schools. 

6. What are the costs and instructor time requirement s of a PSI coursG? 

. Cost data on PSI courses are. fairly sparse. Student-proctor ratios-^ _ 
averaged 10 to 1 across the 17 courses, ranging ixom 3 to 1 to 16 to l.' This 
range caused no significant difference in student attitude toward the courses, 
as expressed- on the Course-Instructor Survey (student course evaluations) . The 
av.-ragc. cost per student for each course (not including the professor' s salary) 
was $35". 67, with a range of $16.11 to .$73.55. The average cost of supplies, 
secretarial and clerical costs, and reproduction .of materials per course was ■ 
$5.11, with a rajige of $.04 to $22,20. '. ' . 
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During the first offering of the PSI courses, comparisons were made between 
nine PSI courses and nine associated control courses. The PSI course developers 
.averaged 24 hours per week, the range being 5 to 50 hours. Faculty tociching 
control courses averaged 12 hours per week, the range being 6 to 18 hours. 
During the second offering, only two PSI course developers kept a record of 
their time expenditure, and the average for these two courses was 10 hours. per 
week. , . ' 

From these data there is no question that a PSI course takes more time, than 
a traditional course, in the first semester it is being developed. The time 
requirement declines, to a reasonable level after the period "of initial develop- 
ment. . 

Instructors were requested to rank-order their activities and the fraction 
of time devoted to each. During the first offering of the course the activities 
were ranked: 

1. Materials preparation ^ ' 

-2 . Working with proctors^ and students 

3. Record-keeping ■ - ' _ 

4. PSI-related professional interaction (meetings with PSI project group, 
meetings with advisory board, discussions with colleagues, and invited= 
papers) ^ ' . ■ ' 

in 'the. second and succeeding offerings less time is required .for materials 
preparation, while the interaction with students increases. 

7. What are the various causes of procrastination and can' it be mini'atized? 

In order to answer this question, it was first necessary to define 
"procrastination". Members of the .evaluation t6arn defined a procrastinator as 
one whose early rate of progress is such that his required late rate must be 
twice-his earlyxxate in order to finish all units of the course without taking 
an incomplete. ' The early period is defined as the first two-thirds pt the total 
number of class days, and the late period is the last third. This means |hat a 
student identified as a procrastinator will be covering -the same number of units, 
or more in the last one-third of the course-as he did in the first two-thirds. 

Using .this definition the following conclusions have. been drawn (941 students 
in the sample) : ' , . ^ 

1. Procrastinators have lower grade point averages and SAT scores than non- 
procrastinators. Among graduate ;students there is no difference between 
procrastinators and non-procrastinators on Graduate. Record Examination^ 
scores. 

2. Freshmen and seniors have the -highest procrastination rate. No other 
significant differences, were found for student classification. 
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3. Students taking six- hours of course work or less had a lower procrasti- 
nation rate than students, taking tan .hours or more . 

4. Numbers pf hours worked on outside jobs had no. effect; on procrastination. 

5. / Previous' ex^)erience with PSI courses lowered procrastination, rates. 

6 ■ Students who have had no previous experience with PSI courses are more 
likely to procrastinate, than students who have had a PSI course before, 
This result is independent of the '.experienced students' attitudes toward 
. PSi (positive, neutral, or negative) . , 

7. Procrastination rates dropped from .the first offering to the second 
offering of a course. Instructors explained this by pointing out that 
revision of their materials improved the course. 

•8. No relationship was found between proctor/student ratios and proportion 
of procrastinators in a class. ^ . 

9. Progress lines had mixed effects on procr^stinatipn. The use of deadlines 
or modules (allowing students to take a test over several units at once) 
had little if any effect; 
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IX). 



Procrastination does not indicate less mastery. 



11. Procrastination had a direct effect on course, grade. 

' ■ 'i . 

8. PSI courses regularly produce a higher drop ouf rate than regular 
courses. Can this rate be reduced and if so, how? ■ 

Six comparisons were made between PSI and control classes in the spring 
of 1973. In two of these comparisons the PSI course had a significantly higher 
rate of dropouts, but in the other four courses there was no significant difference 
between PSI courses and control courses. Beginning with the fall semester of 
1973 and thereafter,, the drop rate in PSI courses has not be.en higher, and in. 
fact has been lower in every case, but the difference is not statistically 
significant. ^ • " _ 

At the beginning of the: PSI project our plans were to run the courses in a 
.strict <,Glf-paced format, allowing, students to take a grade of "Incomplete and 
to spend as much a.s an extra semester to complete their PSI course, if they r,o 
desired. Ass a result, 261 of che students taking- .PSI courses during the spring 
of 3 073 took a grade of Incomplete at the end of that semester. w4 soon found 
out that this created some unanticipated problems. The University ^bf Texas at 
Au.stin grading policy scores an Incomplete as 0 grade points for X- hours _ot 
credit, and so until the grade of incomplete is changed into a final grade, it is 
scored exactly the same as an F. None of 'the Associate Investigators on the PSI 
■project knew of this policy, nor did several of the personnel- in the Registrar s 
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offico. Wc became aware of it quickly, though, when several good students ^lost 
scholarships and others failed to receive invitations to various honor societies 
because their grade point average' wak affected., ^ \ . 

Wo quickly changed our policy, and agreed to limit the grade of Incomplete 
to those cases for which .that grade normally would have been employed. Thus 
our courses were constrained to begin ,and\end on definite dates, although the 
student's progress within the course was still selfr-paced. As a reisult the 
nun±^r of Incomplete grades allowed' in the fall semester of 1973 dropped to^ 
less than 5*?.. ' . ^ 

It might be mentioned that of the students who received Incompletes in a 
PSi cour5p_5.4jb__completed the course and obtained, a final letter grade within 
one semester. 

Personal and telephone interviews were held with '58% of the students who ^ 
dropped either a PSI .course or its matched control course. Students dropping 
control courses ^commonly said they weren't doing well in them or were failing* 
Students- dropping the PSI courses all said they had gotten behind, liot one 
' said he was not doing well in the course. 

9. ygiiat is the effect of class size in PSI courses? 

The PSI classes were- arbitrarily grouped into "small" classes ,(10 to 
47 students) and "large" classes (65 to 370 students) • St^udents in the small 
classes tended to react more favorably to PSI on the Cou^e-Instructor Survey, 
but even students in the large classes were neutrixl to f^avorable. No relation- 
ship was found between thfe size of class and the instructor time requirement. 

I made a serious, blunder when the project began. Every ef fort was made * 
to keep the various administrators advised about what was going on in theil: 
dcpart.-nent or in their college with respect to the project. This was done I 
through memos, and I assumed that they were being 'read and undcrstobd. In 
fact, these administrators were busy people, and although they might have read 
all this material they didn't necessarily understand it. An a^ttempt to get 
them together for A one-day workshop failed, because the several people to 
whom I proposed this idea were unwilling to devote that much time to it* After 
the project had been in operation for one year, we assembled the deans and 
dcpccrtmont chairmen who had faculty members participating in the project, and 
they met with the members of our Advisory Board. It quickly became evident that 
these administrators were not very well informed on what we were doing. It 
would havfe been better if I had gotten them together when the project was. . 
beginning, even if only for an hour. I would advise anyone who is beginning a 
PSI course or project in their department to take particular pains to make surei 
those administrators understand what PSI is, and the way in which it differs 
from more conventional types of instruction. o 

The problem with the grade of Incomplete, which has been discussed above, 
also caused great concern among the project personnel. Since the effects of the 
university's policy have been recognized, a resolution has been introduced in 
the Faculty Senate to try to get the policy changed. These reconuncndations 
were referred to conunittee and no coinmitte.e recommendation has resulted curing^ 
the past year. So for the immediate future .at least, the PSI courses are allowing 
the grade of Incomplete only for conventional reasons. 
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Unusually large enrollments caused complications in at least two of -the 
courses developed in the project. Prior to tho fall of 1973 the enrollment 
in Electrical Kngi-noering. L .boratory I had never exceeded 90 students. Thus 
Dr. I^oth made preparations ror handling 90 students in his Self-paced version 
of -the course, only to be greeted by 118 registrants! By the time the course 
had begun- he was -unable to obtain the additional laboratpry equipment needed, 
and lie was also vlnable to obtain additional proctors, as the upperclassmen and 
graduate students who would have been suitable had accepted other' part tune 
employment. lie further discovered that although a proctor-to-studont ratio 
.of 1 to 10 was satisfactory for a -lecture course he had developed earlier, this 
ratio was not sufficient for a laboratory course, and a ratio of 1 proctor to 
6. students. was more realistic. His course did not run smoothly during the fai; 
semester. When.^the course was offered for the second time during the spring of 
1974, tne new laboratory equipment had been received: and installed, and he nad 
arranged for the larger number of proctors needed. Also the enrollment in the 
course was _normali As a r.esult the second offering was quite successful. 

The PSI course in Engineering Physics I was. similarly plagued with unusual 
enrollment; The projected engineering enrollment in this course was about 300 
students, who were to be about evenly divided between the PSI section and a' . . 
section taught by conventional methOfJs.^ The actual enrollment was about^^O 
students; requiring 'two sections taujght by conventional methods .and a PSI^ _ 
section of 37b students. The unexpected problems with which Dr. creeson had \ 
to cope included a shortage of textbooks for the first month, a student popu- 
lation in the self-paced laboratory which .'as very much larger than ;anticipated, 
and a shortage of availabje proctors. The course nevertheless was success, 
and- during the second offering it is proceeding very smoothly. 

I have been very inteiested in following the fate of the seventeen courses 
developed in this project whe% the outside funding^ disappeared. Although it _is - 
rather early to draw any conclusions, indications are that at least twelve of 
the courses have been assimilated into the various departmental curricula, and 
will continue' to be offered using the PSI format. Three will be taught by PSI . r 
when the Associate Investigator developing the course teaches that course, and 
only two are in the questionable category. The courses which seem to be permanent 
are: Structural Dynamics (Craig); Design of Structural Systems in Timber (D. 
Fowier) ; Process Analysis and Simulation (Himmelblau) ; Introduction to Engineering 
Analysis (Hamilton); Introduction to Nuclear Reactor' Theory (Koen) ; Dyriamic 
systems Synthesis (Hoberock) ; Engineering. Economics (Lesso) ; Introduction to 
operations Research (Beightler) ; Probability and Statistics for Engineers (Wagner) ; 
Freshman English composition (Wittig) ; Engineering Physics I (Gle.eson) ; and , 
Principles of Audio and Visual Production (Brooks) . The courses which will be 
l:aught u^ing PSI when the course developer teaches them include Electrical 
Engineering Laboratory I (Roth) , Principles of Chemistry (White) , and Engineering 
Statics (W. FoJler and Nacozy) . Those courses which may not be taught using PSi 
in the future are Basic Cataloging and Classification (Herring) and Electrical 
Engineering Materials (Taylor) . 

interpretation of the data acquired by the evaluation team continues , and ; 
further data are being obtained in. the form of follow-up studies. A 
report: is in preparation and should be avaiUble sometime during, the summer of 
1975. 

/ \ ' 
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